Effective Interacting Hamiltonian and Pairing Symmetry of LaOFeAs 
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We establish the general form of effective interacting Hamiltonian for LaOFeAs system based on the symme- 
try consideration. The peculiar symmetry property of the electron states yields unusual form of electron-electron 
interaction. Based on the general effective Hamiltonian, we determine all the ten possible pairing states. More 
physical considerations would further reduce the list of the candidates for the pairing state. 



The recent discovery of the new family of iron based high- 
T c superconductors JH 0, S B Btl has attracted intensive 
experimental and theoretical interests. Although at 

the current stage little is known for its microscopic origin, 
theory has made j*reat advances in understanding the elec- 

1 111 . In particular, a number of 



tronic structures 
pairingmechanisms and 

posedH a en or 



airing symmetries have been pro- 
3 H[H El]. In most of these stud- 
ies, the microscopic Hamiltonian adopted is deterministic for 
the outcome of theory. It is thus desirable to know the general 
form of the interacting Hamiltonian allowed by the symmetry 
of the system, upon which the possible pairing states can be 
systematically analyzed. 

In this paper, we establish the effective interacting Hamilto- 
nian for LaOFeAs system based on the general symmetry con- 
sideration. The peculiar symmetry property of electron states 
near M -point yields unusual form of electron-electron (e-e) 
interaction. Based on the general effective Hamiltonian, we 
determine all the possible pairing states allowed by the sym- 
metry. The stability of these pairing states against the band en- 
ergy splitting and the on-site Coulomb repulsion is discussed. 
The analysis is general enough to be useful for other systems 
with the similar electronic structure. 

Structure and symmetry. The structure of LaOFeAs consists 
of the alternating layers of FeAs and LaO planes. The first 
principles calculations reveal the dominant role of the two- 
dimensional FeAs planes in electron conduction (§, 0, [Till . 
Fig. Q] shows the schematic structure of the FeAs plane. The 
full symmetry group for the system is of PA/nmm lfl9l I20I1 . 
For our purpose, it is sufficient to consider its symmorphic 
subgroup P42m, which is a semi-direct-product of the point 
group Z?2d and the lattice translational group. Figure Q] shows 
the symmetry axes of the eight symmetry operations of D 2 d- 
The point group has four one-dimensional irreducible repre- 
sentations: Ai (x 2 + y 2 ), A 2 (xy(x 2 — y 2 )), B\ (x 2 — y 2 ), B 2 
(xy), and a two-dimensional representation E ((xz, yz)). 

The most notable feature of LaOFeAs system is its multi- 
orbit nature. The Bloch bands form five small Fermi pockets: 
three hole pockets at T-point, and two electron pockets at M- 
point. It was suggested that the hole pockets shrink and disap- 
pear upon doping, leaving the two electron pockets responsi- 
ble for the superconductivity 0] . The two electron pockets are 
of Fe-rf orbit origin, and the Bloch states at the M-point are 
essentially d xz and d yz . Departing from the M-point, these 
states strongly hybridize with d xy orbit, giving rise to the two 
elliptically shaped Fermi pockets [ 22] . 
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Figure 1: Left: structure of FeAs plane. The dark and light As atoms 
reside below and above the plane of Fe-square lattice, respectively. 
The red (thick) square indicates the v2 x v2 primitive cell con- 
taining two Fe atoms. Note that it is also possible to define a 1 x 1 
primitive cell containing only one Fe atom, using a generalized Bloch 
theorem 1 16]. The symmetry axes for Did symmetry operations are 
also indicated. Right: The real Brillouin zone (red thick square) and 
the extended Brillouin zone corresponding to the lxl primitive 
cell (the larger black square). The latter can be folded into the real 
Brillouin zone, yielding the two elliptic Fermi pockets at A/-point 
(shaded) originally located at X and y-points. 



The electron states near M -point have peculiar symmetry 
property. The two degenerated Bloch states at ill-point span 
the subspace for the two-dimensional irreducible representa- 
tion E of D 2 d- Departing from the M-point, the Bloch states 
<Pi(k, r) (i = 1, 2) of the two bands will be transformed by: 

&(pi(k ) r) = (pi(k,a~ 1 r)= ^ D$(a)<pj(ak,r), (1) 

.3=1,2 



where 



& E D 2 d is a symmetry operation, and Dfj(a) 
is the two-dimensional irreducible representation matrix for 
(xz, yz). The transformation property can be established by 
generalizing the usual symmetry argument for Bloch wave- 
functions with the proper assignment of the band index to the 
two states at each fe point, so that the resulting wave functions 
are continuous functions of fe. Note that Eq. ([TJ is possible be- 
cause of the presence of a generalized translational symmetry: 
the system is invariant under the transformations T X P Z and 
T y P z , where T x (T y ) is the translation along x (y) direction 
by the Fe-Fe distance and P z is the reflection z — > — z llrjll . 
With the symmetry, one can define a reduced lxl primi- 
tive cell containing only one Fe atom, and the corresponding 
extended Brillouin zone, as shown in Fig.[T] The two overlap- 
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ping Fermi pockets at M-point in the real Brillouin zone actu- 
ally originate from the Fermi pockets located at the two non- 
equivalent points X and Y of the extended Brillouin zone. 
Without such a symmetry, the hybridization between differ- 
ent d-orbits would re-organize them into two separated Fermi 
pockets that transform within themselves, instead of the two- 
dimensional representation shown in Eq. (Q]). Note that the 
presence of the generalized translational symmetry does not 
prohibit interband coupling through e-e interaction. 

Effective electron-electron interaction. Equation (Q3 is one 
of the peculiarities of LaOFeAs system. It is interesting to 
see how the unique electron structure has effect on the e-e 
interaction. We thus focus on the interaction amongst the two 
electron pockets, which can be written as: 



try Vij(k,k') — v* i (k',k). To make the Hamilto- 
nian invariant under the point group operations, uy(fe) 
must have certain transformation property. For instance, 
*t(fc)* 2 (fc') ~B 2 xi 2 = B u i.e., a[* t 1 (fc)* 2 (fc')]a" 1 = 
D Bl {a)^i\{ar 1 k)^ 2 {a^ 1 k'). To have an invariant partial 
Hamiltonian J2kk' Vl2 (k, k')'i'\(k)ii>2(k'), Vi 2 must have 
v 12 (a- 1 k,a- 1 k') = D Bl {a)v 12 (k,k'), i.e., v 12 ~ B x . Fol- 
lowing the same procedure, the symmetry properties of all 
matrix elements can be determined. They are indicated by 
the superscripts of Vij in Eq. (01. 

To incorporate the spin indexes into the effective interac- 
tion, we generalize the pair annihilation operators ^^(fc) — > 
^a,a{k) = ai s (—k)r^Tg S ,aj s i{k), where a denotes the spin 
pairing channel. When the spin-orbit coupling is negligible, 
the effective e-e interaction has the form [21]: 



x 4 lSl ( fc )4 2S2 (- fc )ai 3 s3(-fc>*4S4(fc'), (2) 

where a is (k) and aj s (fc) are the creation and annihilation op- 
erators for band i = 1, 2 and spin index s =TI- We only con- 
sider e-e interaction relevant to the superconductivity between 
a pair of electrons with the zero total momentum. The e-e in- 
teraction should be interpreted as an effective one, including 
contributions not only from the direct Coulomb interaction, 
but also from the effective interaction mediated by other de- 
grees of freedom such as phonon, or the renormalization effect 
due to the projection of the high-energy sectors. 

Next we explicitly construct the general interacting Hamil- 
tonian invariant under the symmetry operations. From Eq. (Q]), 
it is easy to see that the annihilation operator at (k) transforms 
by aaj(fc)a — 1 = J2j a j{^ 1 k)D B i (a), nere we ignore the 
spin indexes for the moment. As a result, the transformations 
of a\ {k)a\ 2 {—k)a,i 3 (— fe')a, 4 (fe') under the symmetry oper- 
ations belong to the direct-product representation E x E x 
E x E, which can be decomposed to the one-dimensional ir- 
reducible representations 4Ai © 4A 2 © 4E?i ® AB 2 . 

The decomposition can be explicitly constructed by the fol- 
lowing procedures. First, the two-particle annihilation oper- 
ator fc)aj(fe) can be organized to different orbital pair- 
ing channels: * (fe) = a,-(— fe)r t ° Oj(fe) ~ A L , *i(fe) = 
ai(-fc)4aj(fc) ~ B 2 , * 2 (fc) = ad-k^a.jik) ~ A 2 , 
* 3 (fe) = a^-kyfjCLjik) ~ Bi, where t q (a = 1,2,3) 
are the Pauli-matrices, and r° is the unity matrix lEoll . The 
symbol ~ indicates the transformation property of the op- 
erators. For instance, ^o(k) ~ A\ means a 1 ^o(k)a^ 1 = 
D Al (a)'^o(a~ 1 k), where D Al (a) is the transformation co- 
efficient of the irreducible representation A\. Using these 
bases, the effective e-e interaction can be written as: 
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where = [* , * 2 , * 3 ] T , and all the matrix el- 

ements are functions of (fe, fe'), and have symme- 



Hj =^tft 2 (fc)y«(fc,fe')* 2 (fc') 



kk' 

+ Y,^.a{k)V {t) {k,k')^, a {k') (4) 

a^2 

where # a (fc) = [* 0)OJ *i,a, *2,a, *3,a] T , and the ma- 
trices V^(k,k') and V^{k,k') denote the effective e- 
e interactions in the spin-singlet (s) and triplet (t) chan- 
nels, respectively. Both matrices have the same structure 
as the one presented in Eq. ([3). Pauli exclusion prin- 
ciple imposes the further constraints onto the matrix ele- 
ments: v^(-k,k') = g(a)v^(k,k'), ug(fe,-fc') = 
<7(/?)«S(fe,fc')> and «S(-fe,feO = -g{a)v%{k,k'\ 
v%{k, -fe') = -g((3)v®(k, fe'), where g(a) = -1 (1) for 
a = 2 2). The matrix elements v a p(k, k') can be further 
expanded as: 



v^g(k, fe') 



E 

nn',fle-Ri X-R2 



R1-R2 fRi 

nn' ,q/3 



fFWffiW, (5) 



where /,f (fe) denotes a complete set of functions that trans- 
form by the irreducible representation R. The summation 
should be run through all the possible combinations of R\ and 
i? 2 which yield R G R± x R 2 . For instance, for v B ^, there 
are five possible combinations, A\ x B-y, B\ x Ai, B 2 x A 2 , 
A 2 x _B 2 , E x E, based on the product rules of the group. 

To be more explicit, we construct an expression using only 
the lowest order polynomials for each irreducible representa- 
tion: s ~ 1 ~ Ai, <? ~ k x k v (k\ — fcy) ~ A 2 , d x 2_ y 2 ~ 

^ - fc y ~ #1> rf xj/ ~ fc^y ~ -B 2 , [PajPy] ~ [fexjfcy] ~ 

Such an expression contains the full information of symme- 
try. It could also be a good approximation for LaOFeAs sys- 
tem since all its Fermi pockets are small, and the higher (n-th) 
order contributions are scaled by (kpa) n , where a is the scat- 
tering length of the effective interaction, and kp is the Fermi 
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wave vector. The explicit form of v^l (fe, k') reads: 



4 a) =< + < ( k l - ~ K]) + < 2 k x k v k' x k' y (6) 



, d 2 ; 



+ vfk x k y (k x k v )k' x k'(k. 



"01 



"03 



W 22^ — ^2 { k xk x + kyky) 



~^oi k x k 



Ci' 9 ' 



(k x — ky)k x k y (k x — k y 2 )+ 
v oi 2 k' x k y + Uqi 1 k x k y {k 2 x — k 2 ){k x — ky 2 ), 
v 03 dl ( k 'x ~ k/y) + v 03 9 k x k y k' x k' y (k x — k'y)+ 
v tk S { k x ~ ky) + v 03 2 kxk y (k 2 , — ky)k x k y , 



0, 1, 3, 



—Viz^xky {k x 
vf 3 k x k y (k x 



d, -dn 



ky) k x k y 



v 13 K x K y yK x 



1 23 
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(8) 

(9) 

(10) 
(11) 



Similarly, the explicit expression for v^l reads: 



(*) 

"22 



v 2 1 (k x ky)(k x 



ky ) ~i~ k x kyk x ky 





+ V2k x k y (k x ky)k x ky(k x k y 2 ), 


(12) 


(t) 

< 


=v f (yk x k x + kyky) , i = 0, 1, 3, 


(13) 


(t) 


=Vq 1 p {k x k' y + k' x k y ) , 


(14) 


(*) 

v 03 


=Vq 3 p (k x k x — kyky) , 


(15) 


(*) 


=v i3 P {kxky — k y k x ) , 


(16) 


(t) 
«23 


Jt) _ „(*) _ o 

— U 12 — U 02 — U. 


(17) 



Possible pairing symmetries. Equations <f4l> — (ITTb provide 
the basis for deducing the possible pairing symmetries. Ba- 
sically, the interacting Hamiltonian Eq. (0]l describes how the 
electron pairs in different orbital and spin pairing channels are 
coupled, while Eq. (0 (or (|6]i-(fT7Ti) dictates the coupling be- 
tween the different momentum pairing symmetries. The pair- 
ing instability of the system can be determined by consider- 
ing a Cooper pair out of the Fermi sea. The Cooper equation 
reads 112 311 . 



/^a/3(fc)V Q ,a(fe)+5]^ a /3 ) (fe,fc')^(fe')V'/3,a(fc , ) 

= ^Va,a(fc) (18) 

where h a p (fe) is the kinetic energy of the Cooper pair, and has 
the non-vanishing elements: hoo(k) = h^(k) — |£i(fc)| + 

|&(fc)|, h n (k) = h 22 (k) = |6(fc) + &(fc)|, M*0 = 

^30 (fe) = |£i(fe)l - I6(fe)|, where &(fe) = e^k) - fi is 
the single electron band energy relative to the Fermi sur- 
face. Note that the interband Cooper pairs cannot exist in 
the non-overlapping areas of the two Fermi pockets, which 
are excluded from contributing the interband pairing poten- 
tial by the measure wp(k): wo(k) = ws(k) — 1, W%(k) = 
W2(k) = 6(£i(k)^2(k)), where 9(x) is the Heaviside func- 
tion. A bounding state solution of the equation signifies the 



instability of the normal Fermi liquid, and the resulting super- 
conducting state will have the order parameter Ay- :SS / (fe) ~ 

T ij T ss< l&W + €j( k )\i>ai,a( k )> approximately. 

It is easy to see both h a p and wp(k) do not change the 
symmetry characteristics of Eq. ( fT8l from the one dictated 
by v^l . It is thus straightforward to use Eq. d6ii-([T7li to de- 
termine the possible pairing states of the system. It can be 
readily observed that the pairing states must have the definite 
parities in exchanging spin/orbit/momentum indexes, as the 
states with the different parities do not mix. A closer analy- 
sis reveals the particular way of mixing between the different 
pairing symmetries and the orbital pairing channels. For in- 
stance, in the spin singlet channel, an s-wave component in 
orbital pairing channel (-00 ~ s) will induce ipi ~ d xy (by 



u 01 ') and ?/>3 ~ d x 2_ y 2 (by Vq 3 '). These states form a closed 
subspace for an eigenstate of Eq. ( fT8l . The corresponding su- 
perconductivity order parameter has the form IU8I1 : 



A^(fe)~^r^ a 



s + d x 2_ % 

d x y 



(19) 



The similar analyses can be carried out for all other possible 
combinations. A complete list of all possible pairing states is 
presented in Table U 

More physical considerations may further reduce the list 
of candidates. One of the most important factors is the band 
energy splitting £i(fe) — £${k), which acts like a "Zeeman" 
field and will suppress the interband pairings. Its adverse ef- 
fects to the different interband pairing states have the relative 
strengths d x 2_ y 2 > s « p ks g > d xy . The strong band 
splitting tends to suppress the pure interband pairing states 
(5) and (7)-(10), although the state (9) may be more robust 
than the others in the group. On the other hand, those states 
mixing the interband and intraband pairings, i.e., the states 
(l)-(4) and (6), may not be as sensitive, as long as the pair- 
ing is dominated by the intraband attractive interaction. An- 
other potential factor is the strong on-site Coulomb repulsion, 
which would suppress s-wave components in states (l)-(3) 
and (7). As a result, the states (l)-(3) will be dominated by 
the ei-wave pairing symmetries. Finally, the smallness of the 
Fermi pockets in LaOFeAs system may also have implications 
on the possible pairing forms: the screening of the bare e-e in- 
teraction by the Fermi gas of small kp will render the effective 
interaction spatially extended. It is thus unlikely for LaOFeAs 
system to form spatially localized bond-like-pairings, as that 
happens in high-T c cuprates H20TI . Moreover, in the limit of 
weak coupling (kpa <C 1), one may expect that the attrac- 
tive e-e interaction in the p-wave channel, if presents, would 
be stronger than that in the d-wave channels. Note that in 
many microscopic models, the p-wave channel is absent, due 
to the improper adoption of a two-orbit model for describing 
the band structure near the M -point 1 16], while the symmetry 
argument clearly suggests its presence. The possibility of p- 
wave pairing state (i.e., the state (6)) has been demonstrated in 
Ref. 11611 . using a microscopic model including three d-orbits 
and on-site Hund's coupling. 
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-^or bit f spin 



S + d x 2_ y 2 

dxv 



S d x 2_y2 



-4i 



— S + d x 2_ y 2 



Bi 



dxy + g S 

S d x y Q 



B> 



dxy+g d x 2_ y 2 
d x 2_y2 " d X y ~~f~ Q 



A, 



p x 

~Px 



Py 

-Py 



aiPx Py 

Py &2Px 



Ct2Py Px 
Px OL\Py 



+ E 



S 

-s 



+ A 2 



d x 2_ y 2 
-d x 2_ y 2 



+ B 2 



d X y 
~dxy 



+ Si 



10 



9 

-g o 



+ At. 



Table I: The possible pairing states. P or bit (-Pspin) denotes the par- 
ity of state in exchanging the orbit (spin) index. I.R. shows the irre- 
ducible representation the pairing state belongs to. Note that the table 
can also be constructed by doing a symmetry classification of order 
parameter 1 19, 20], and the different pairing states belonging to the 
same irreducible representation will in general mix. The schematic 
plots for some pairing states are shown in Fig. [2] 




(1) (2) 



Figure 2: Schematic plot for multi-orbital-channel pairing states 
(-Porbit = +!)• In plotting the states (1) and (2), we have assumed 
that the s-wave component is smaller than the d-wave components, 
due to the presence of the on-site Coulomb repulsion. 



In summary, we have constructed the general effective in- 
teracting Hamiltonian conforming to the peculiar symmetry 
of LaOFeAs system. A complete list of the possible pairing 
states is also determined. The general effective Hamiltonian 
can act as a maximal model, from which the minimal model 
can be constructed for a given pairing state. This is useful 



since the peculiar symmetry property of the electronic state 
may render the first-sight intuitions misleading. The ten pair- 
ing states put strong constraints to the possible forms of su- 
perconductivity, and could act as the consistency check for the 
proposed pairing symmetries. Finally, our approach is com- 
pletely general. The result presented here would be useful for 
other systems with the similar electronic structure. 
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